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Method of partially scrambling a data stream 

The invention relates to a method of partially 
scrambling a data stream including transport stream packets, 
each transport stream packet having a header and a payload, 
wherein a sequence of transport stream packets has payloads 
5 carrying encoded data elements, arranged in units, including: 
selecting transport stream packets forming a sub- sequence of 
the sequence, and 

scrambling at least part of the payloads of each transport 
stream packet in the sub- sequence. 

10 The invention also relates to a system for partially 

scrambling a data stream including transport stream packets, 
each transport stream packet having a header and a payload, 
wherein a sequence of transport stream packets has payloads 
carrying encoded data elements, arranged in units, including: 

15 a port for receiving the data stream; and 

an arrangement for processing the data in the stream, wherein 
the system is configured to select transport stream packets 
forming a sub- sequence of the sequence, and to scramble at 
least part of the payloads of each transport stream packet in 

20 the sub-sequence. 

The invention also relates to a computer program. 
The' invention also relates to a signal carrying a 
data stream including transport stream packets, each transport 
stream packet having a header and a payload. 

25 Examples of such a method, system, computer program 

and signal are known from WO 03/061289-Al . In the known sys- 
tem, a cable system headend selects A/V content packets at a 
packet selector for encryption. Packets selected for encryp- 
tion are chosen so that their non- receipt would severely af- 

30 feet the real-time decoding of a program, and any possible 
post processing of recorded content. That is, only critical 
packets are encrypted. For the video and audio, this can be 
accomplished by encrypting "start of frame" transport stream 
packets containing PES (packet! zed elementary stream) headers 

35 and other headers as part of the payload, since without this 
. information the STB decoder cannot decompress the MPEG com- 
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pressed data, MPBG-2 streams identify "start of frame" packets 
with the "Packet Unit Start Indicator" in the transport 
header. Generally, packets carrying a payload that contains a 
group of pictures header or a video sequence header can be 
5 used to effect the present scrambling technique. Other criti- 
cal or important packets or content elements may also be iden- 
tified for encryption that could severely inhibit unauthorized 
viewing without departing from the present invention. For ex- 
ample, MPEG intra- coded or I frame picture packets could be 
10 encrypted to inhibit viewing of the video portion of the pro- 
gram. 

A problem of the known method is that the encryption 
of all TS packet payloads including PES packet headers or a 
selected critical packet will lead to a stream in which a 

15 large percentage of packets have an encrypted payload-. Tl^is 
makes the method unsuitable for broadcasting to devices with 
limited processing capacity for decryption. The mere encryp-- 
tion of only a few of the TS packets payloads including PES 
packet headers or a selected critical packet will not suffice 

20 when the payloads of the packets include audiovisual data en- 
coded using advanced compression techniques with a high degree 
of resilience to packet loss. In that case, an \anauthorized 
receiver would be able to decode the content using the data 
• left in the clear. 

25 It is an object of the invention to provide a 

method, system and computer program. of the kinds mentioned 
above, that enable scrambling of the payloads of only a se- 
lected few of the transport stream packets whilst maintaining 
effective content protection in the presence of advanced de- 

30 coder techniques for coping with missing encoded data. 

This object is achieved by means of the method ac- 
cording to the invention, which is characterised by monitoring 
the payloads of at least some of the transport stream packets 
in the sequence for the presence of data indicating a boundary 

35 between two subsequent units, and, for selected units, includ- 
ing at least one of the transport stream packets carrying data 
forming part of the selected unit in the sub-sequence. 
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Because transport stream packets are selected to 
form a sub- sequence, i.e. a sequence formed of fewer than all 
of the transport stream packets in the sequence, the descram- 
bling load on a decoder receiving the partially scrambled 
5 stream is reduced. Because the encoded data elements are 

structured in units, they are also processed on a unit -by-unit 
basis when being decoded. Because the entire payload of the 
transport stream packets is monitored for the presence of data 
indicating a boundary between two subsequent units, it is pos- 
10 sible to ensure that only selected units are made xonintelligi- 
ble. The number and nature can be made dependent on the decod- 
ing process. This also takes account of the fact that the data 
forming the unit may be carried in the payload of a plurality 
of transport stream packets. Thus, the scrambling can be tai- 
ls lored more closely to the encoding technique. 

In a preferred embodiment, wherein the data stream 
is a multiplex of elementary streams, the method includes 
identifying at least one elementary stream including the se- 
quence of transport stream packets and monitoring only pay- 
20 loads of packets in the identified elementary stream (s) . 

Thus, a relatively efficient method is provided for 
partially scrambling the transport stream packet payloads. 

In a preferred embodiment, the selected units in- 
clude units containing at least part of an encoded representa- 
25 tion of a picture. 

This embodiment has a relatively high impact in a 
decoder. The pictures contained in the respective units are 
almost invariably the desired output of the decoder, which can 
no longer be provided without descrambling the transport 
30 stream packet payloads containing these selected units. 

In a preferred embodiment, wherein each unit con- 
tains an indication of the type of data to follow and a part 
containing that data, the type of each unit in the monitored 
payloads is determined from the indication and the unit is in- 
35 eluded among the selected units if the type corresponds to at 
least one specific type. 
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Thus, a large reduction in the number of transport 
stream packets of which the payloads are scrambled is 
achieved, whilst maintaining effective content protection. 

Preferably, units of types other than the specific 
5 type(s) are randomly included among the selected units. 

Thus, extra content protection is achieved. 
In preferred variants of the previous two embodi- 
ments, the types are defined by the encoding technique with 
which the encoded data elements have been formed. 
10 Thus, those packet payloads containing units most 

critical to the decoding process are selectable for scram- 
bling. This makes the content protection moire effective, as it 
is precisely tailored to the particular CODEC that is used. 

In a preferred embodiment, wherein the encoded data 
15 elements are decodable using a predictive decoding technique, 
the specific types include a type of data element allowing a 
prediction to be derived from only the decoded data belonging 
to the data element. 

Because these data elements allow random access into 
20 a stream of encoded data, making them inaccessible has a high 
impact on the decoding process, which generally cannot start 
without these encoded data elements. 

In a preferred embodiment, up to a maximum number of 
trcuisport stream packets following a first transport stream 
25 packet carrying data forming part of a selected unit are in- 
cluded in the sub-sequence. 

This decreases the load on a receiver whilst main- 
taining adequate protection. The maximum number is chosen so 
as to make error correction impossible. In particular where 
30 the transport stream packets are all of a standard length, in- 
cluding up to a maximum number of all transport stream packets 
carrying data forming part of the unit avoids scrambling more 
payloads than is required to render ineffective techniques in 
a receiver for coping with the loss of data. Thus, effective 
35 protection is achieved whilst the burden on an authorised re- 
ceiver providing access to the partially scrambled stream is 
kept as low as possible. 
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According to another aspect, the system according to 
the invention is characterised in that the system is config- 
ured to monitor the payloads of at least some of the transport 
stream packets in the sequence for the presence of data indi- 
5 eating a boundary between two siibsequent units, and, for se- 
lected units, to include at least one of the transport stream 
packets carrying data forming part of the selected unit in the 
sub- sequence . 

The system is suitable for generating a partially 
10 scrambled stream in which the data elements are well protected 
against access by unauthorised receivers, but which does not 
place large demands on the processing capacity of authorised 
receivers . 

Preferably, the system is configured to include up 

15 " to a maximum number of transport stream packets following a 
first transport stream packet carrying data forming part of a 
selected \init in the sub-sequence, and provided with an ar- 
rangement for setting the maximum number. 

This decreases the load on a receiver whilst main- 

20 taining adequate protection. The maximum number can be set so 
as to make error correction impossible. In particular where 
the transport stream packets are all of a standard length, in- 
cluding up to a maximum number of all transport stream packets 
carrying data forming part of the unit avoids scrambling more 

25 payloads than is required to render ineffective techniques in 
a receiver for coping with the loss of data. Thus, effective 
protection is achieved whilst the burden on an authorised re- 
ceiver providing access to the partially scrambled stream is 
kept as low as possible. Because the maximum number can be 

30 set, factors like the profile of typical receivers, the manner 
of encoding and the number of selected units can be taken into 
account . 

According to another aspect, the invention provides 
a computer program adapted, when run on a computer, to config- 
35 ure the computer to execute a method according to the inven- 
tion. 

According to another aspect, the invention provides 
a signal carrying a data stream including transport stream 
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packets, each transport stream packet having a header and a 
payload, wherein a sequence of transport stream packets has 
payloads carrying encoded data elements, arranged in units, 
each unit being of a certain type, wherein at least part of 
5 the payload of each transport stream packet in a sub-sequence, 
of the sequence, is scrambled, wherein for each unit of a type 
corresponding to a selected type, the sub-sequence includes at 
least one of the transport stream packets carrying data form- 
ing part of that unit, wherein at least one of the transport 

10 stream packets includes data indicating a boundary between two 
subsequent units. 

The signal is suitable for being unicast, multicast 
or broadcast to receivers with limited processing capacity for 
descrambling, but equipped with decoders with a high degree of 

15 tolerance to data loss. These include wireless devices in par- 
ticular. 

The invention will now be displayed in further de- 
tail with reference to the accompanying drawings, in which: 

Fig. 1 shows schematically a system for partially 
20 scrambling a data stream; 

Fig. 2 shows schematically a data stream comprised 
of transport stream packets in accordance with the MPEG-2 
standard; 

Fig. 3 shows schematically the composition of an 
25 MPEG-2 transport stream packet header; 

Fig. 4 shows schematically the composition of a Pro- 
gram Elementary Stream packet carried in the data stream of 
Fig . 2 ; and 

Fig. 5 shows schematically the composition of a Net- 
30 work Adaptation Layer unit as defined by the H.264/AVC stan- 
dard, and carried in the data stream of Fig, 2. 

The invention will be explained in an embodiment for 
partially scrambling a data stream including transport stream 
packets in accordance with ISO/IEC 13818-1, or the MPEG-2 sys- 
35 tems standard. In this particular embodiment, MPEG-2 is used 
as the delivery mechanism for audiovisual data encoded in 
accordance with the H.264/AVC standard. It will be understood 
that the invention can be applied to other delivery mechanisms 
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than MPEG-2. One exanple is the Internet Protocol (IP), which 
defines IP datagrams having a header and a payload. Similarly, 
the use of H.264/AVC as content encoding technique is an ad- 
vantageous example, due to the high degree of con5)ression and 
5 acceptable quality that is achievable. However, an alternative 
would be MPEG-2 video coding, in which the encoded video is 
arranged in frames. 

In the example to be described in detail, the data 
stream is in the MPEG-2 transport, stream format. The example 

10 may be adapted to the program stream format. The term trans- 
port stream packet therefore does not mean that the use of a 
particular format is prescribed. It is observed that, when the 
' program stream format is used, data is transmitted in PES 
packets, each having a header, and that PES packets are 

15 grouped in packs, each having a pack header. 

In Fig. 1, a video file server 1 provides an MPEG-2 
systems stream carrying H.264 encoded video, amongst others. A 
multiplexer 2 splices Conditional Access (CA) messages, into 
the data stream. The CA messages include Entitlement Manage- 

.20 ment Messages (EMMs) , generated by an EMM generator 3, and En- 
. titlement Control Messages (ECMs) , generated by an ECM genera- 
tor 4. The ECM generator 4 generates Control Words (CWs) . 
These are provided to a scrambling unit 5 arranged to par- 
tially scramble the output data stream of the multiplexer 2. 

25 The CWs are encrypted under a service key provided by the EMM 
generator 3, which packs the service keys into the EMMs. Thus, 
the CA scheme used corresponds siibstantially to the Digital 
Video Broadcasting (DVB) common scrambling algorithm, which is 
known per se, e.g. from ETSI technical report 289, and not de- 

30 scribed in further detail here. It is observed that the sepa- 
ration into conponents in Pig. 1 is of a functional nature. 
Several or all of these could be combined into a single physi- 
cal device, just as the functionality of certain of these com- 
ponents could be provided separately by different devices. 

35 Furthermore, the implementation of this functionality may be 
in software or hardware. 

Fig. 2 shows a data stream 6 including transport 
stream (TS) packets 7a-7p. Each TS packet 7 has a TS packet 
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header 8a- Bp and a TS packet payload 9a- 9p. The data stream 6 
is a multiplex of elementary streams. Each elementary stream 
corresponds to a coded bit stream, e.g. a coded audio, video 
or data stream. For exanqole, the ECMs are carried in a sepa- 
.5 rate elementary stream, whereas at least one elementary stream 
received by the scrambling unit 5 is a stream of H.264 encoded 
video . 

Fig. 3 shows the make-up of a TS packet header 8. It 
includes a sync byte 10, a payload_unit_start_indicator 11, a 

10 packet identifier (PID) field 12, a transport scrambling con- 
trol field 13 and, optionally, an adaptation field 14 . Other 
parts are described in ISO/IEC 13818-1. Each elementary stream 
corresponds to a unique PID. Thus, the scrambling unit 5 is 
able to identify the elementary stream or streams carrying 

15 H.264 encoded video. For the sake of efficiency, only> the TS 
packets 7 belonging to such a stream or streams are processed. 
As is known from ISO/lEC 13818-1, an MPEG-2 transport stream 
will contain Programme Specific Information (PSI) identifying 
the various elementary streams and their allocated PIDs, as 

20 well as the type of data carried in the elementary stream. One 
type, identifiable in a Programme Association Table (PAT), is 
H,264. The scrambling unit 5 can use the PSI to identify the 
PID(s) of the elementary stream(s) to be partially scrambled. 

In the following, it will be assumed that only one 

25 elementary stream is to be partially scrambled. The TS pack- 
ets 8 with the PID corresponding to that particular elementary 
stream are retrieved from the data stream, thus forming a se- 
quence of TS packets 8 having TS packet payloads 9 carrying 
H.264 encoded data elements. 

30 Preferably, the encoded data elements contain at 

least parts of encoded representations of pictures. A picture 
is a frame or field in a video secjuence (i.e. a full image or 
alternate lines) . Macroblocks, blocks of sixteen by sixteen 
luma and chroma samples, are formed from the data of each pic- 

35 ture. This is done in accordance with raster scan, a mapping 
of the rectangular two-dimensional pattern of macroblocks in 
the picture to a one -dimensional pattern, such that the first 
entries in the one -dimensional pattern are from the first 'top 
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row of the two-dimensional pattern scanned from left to right, 
followed by macroblocks from the next rows, each scanned from 
left to right. The picture is partitioned into slice groups, 
subsets of macroblocks. A slice contains macroblocks that are 
5 consecutive in the raster scan within the slice group, but not 
necessarily within the picture. Thus, it is possible to allo- 
cate every other macroblock in the raster scan of the picture 
to a separate slice group, for example. A slice is decoded 
only on the basis of samples from within that slice, i.e. in- 

10 dependently of the samples in other slices. However, when the 
data in one slice is lost in transmission, use may be made of 
the data in another slice to »fill in the blanks' in the de- 
coded picture. 

The frequency of sanpled pictures provides a divi- 

15 sion in time, in addition to the topographical partitioning 
provided by the slices. H.264 is. an example of a predictive 
encoding method: a pixel value is encoded as the sum of a pre- 
dicted value and a difference value, which latter value is re- 
duced as much as possible during encoding. For slices contain- 

20 ing data from the first picture and from pictures defined as 
random access points, the predicted. values are based only on 
values within that picture itself, and not on those in pic- 
tures at a different point in the order of transmission. Such 
slices are called intra-coded slices. The remaining slices may 

25 be coded so as only to be decodable using also values in other 
pictures in the order of a sequence of pictures. Thus, it is 
possible to decode a sequence of encoded pictures by starting 
at an intra-coded picture, but not by starting at another type 

of encoded picture. 

30 Thus far, the description of relevant parts of H.264 

has concerned only the so-called Video Coding Layer (VCL) . To 
transmit the encoded slices, they are packaged into so-called 
Network Adaptation Iiayer (NAL) units 15a- 15x (Fig. 1) . Each 
* slice is contained in a single NAL unit 15. Sets of NAL 

35 units 15 form Access Units (AUs) . Each AU always contains a 

jprimary coded picture, i.e. all macroblocks of the picture. It 
will be appreciated that the data size of a NAL unit 15 varies 
according to the number of slice groups, the type of (entropy) 
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coding used to generate the slices, etc. Thus, the sequence of 
TS packets 7 contains NAL units 15 of varying lengths. 

Each set of NAL units 15 forming an AU is carried in 
one Program ElementaiY Stream (PES), packet 16, which in turn 
5 is carried by the TS packets 7. The composition of the PES 
packet 16 is shown in Fig. 3. It includes a packet start code 
pre-fix 17a-d (see also Fig. 2) . The packet start code pre- 
fix 17 is a code of twenty- four bits' length. Together with a 
stream_id 18 it constitutes a packet start code that identi- 

io fies the beginning of a PES packet 16. In contrast to the TS 
packets 7, which are of a standard, fixed length, a PES 
packet 16 is of variable length. The length is indicated in a 
PES packet length field 19. This field 19 is optionally fol- 
lowed by a PES header 20. Thereafter comes the PES packet pay- 

15 load 21, i.e. the NAL units 15. 

It is noted that the stream_id 18 specifies both the 
type and number of an elementary stream- It may thus be used 
as an alternative to identify the elementary stream to be par- 
tially scrambled by the scrambling unit 5. The start of a new 

20 PES packet 16 always follows immediately upon a.TS packet 
header 8, in which case the payload_unit_start_indicator 11 
has the value 'TRUE'. No two PES packets 16 start in the same 
TS packet 7. . 

Fig. 4 shows the composition of a NAL unit 15 in a 
25 format for transmission in a byte stream. It is preceded by a 
start code pre-fix 22. The start code pre-fix 22 is a unique 
sequence of three bytes, equal to '0x00 0001 », embedded in the 
byte stream as a pre-fix to each NAL unit 15. Thus, the start 
code pre-fix 22 indicates a boxindary between two subsequent 
30 NAL units 15. The start code pre-fix 22 is followed by a 

forbidden_bit 23, a nal_storage_idc 24 and a nal_unit_type 25. 

Ten different types are defined by the encoding 
technique with which the slices have been formed. One of these 
is the Access Unit Delimiter (AUD) type. The presence of a NAL 
35 unit 15 of this type indicates the boundary between subsequent 
AUs. The first NAL unit 15 of an AU is always of this type. 
Another possible type is the Instantaneous Decoder Refresh 
(IDR) type. Such a NAL unit 15 contains an Intra coded slice. 
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Thus, the corresponding value of the nal_unit_type 25 indi- 
cates that byte-aligned data 26 following it is part of a data 
element representing an intra-coded picture. 

Having retrieved from the data stream 6, the eleraen- 
5 tary stream to be partially scrambled, the scrambling unit 
monitors the TS packet payloads 9 of the TS packets 7 in that 
stream for the presence of the start code pre-fix 22. The 
scrambling unit 5 is able to differentiate between the packet 
start code pre-fix 17 of a PES packet 16 and the start code 

10 pre-fix 22 indicating a boiandary between subsequent NAL 

units 15. It is observed that a PES packet start code pre- 
fix 17 always follows immediately upon a TS packet header 8. 
The scrambling unit 5 is able to monitor parts of the TS 
packet payload 9 separated by the TS packet header 8 by compo- 

15 nents indicating the start of an elementary stream packet, 
i.e. a PES packet. 

Once the end of a NAL unit 15 has been identified, 
the system determines the type of the NAL unit 15 as indicated 
by the nal_unit_type 25. At least if the type corresponds to 

20 IDR, one or more of the TS packets 7 carrying data forming 
part of that NAL unit 15 is selected for inclusion in a sub- 
sequence. The TS packet payloads 9 of the TS packets 7 in the 
sub-sequence are scrambled. It is observed that the term 'sxib- 
sequence' is a notional one. It is used herein to refer to an 

25 ordered sub-set, i.e. a lesser number, of the TS packets 7 in 
the sequence of TS packets 7 forming the elementary stream. 

Preferably, a number of additional TS packets 7 fol- 
lowing the first TS packet 7 carrying data forming part of the 
selected NAL unit 15 is also selected for inclusion in the 

30 sub-sequence to be scrambled. These additional TS packets 7 
are selected from the same elementary stream on the basis of 
the FID as determined from the PID field 12. The system in- 
cludes means for adjusting the number of additional packets 
that are selected. Thus, the operator of a conditional access 

35 system can achieve a compromise between the level of content 
protection and the level of processing capacity needed to de- 
scramble the partially scrambled stream. 
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The fraction of scrambled TS packets 7 in the se- 
quence carrying the elementary stream may be relatively low 
when selection is based on the presence of NAL units 15 of 
type IDR. In such cases additional TS packets 7 may be se- 
5 lected for scrambling. In an advantageous embodiment, the sys- 
tem is configured or configurable to select units of types 
other than IDR at random. The TS packet payload 7 of at least 
one of the TS packets 7 carrying the selected unit is also 
scrambled. The other types may be all or a sub-set of the nine 

10 defined types other than IDR, In one embodiment, the rate at 

which additional TS packets 7 are included in the sub- sequence 
for scrambling is continuously adjusted. This is done in such 
a meuiner as to keep the fraction of the TS packets 7 in the 
sub-sec[uence relative to all TS packets in the sequence repre- 

15 senting the elementary stream at, or below, a. certain level, 
e.g. 5 % . 

The partially scrambled data stream is mod\ilated by 
a transmitter 27. In a preferred embodiment, the MPEG-2 trans- 
port stream packets are modulated onto CDMA (Code Division 

20 Multiple Access) carriers in accordance with the sys-tem E 

variant of the Digital Audio Broadcasting standard (ETSI 300 
401). Thus, the transmitter transmits a signal carrying the 
partially scrambled data stream. By using a wireless transmis- 
sion technique, the partially scrambled data stream is made 

25 available to mobile receiver/decoder devices. These devices 
are provided with descrambling and decoding capability, pref- 
erably implemented in software. In that case, the signal, more 
particularly the way in which the data stream has been scram- 
bled, allows descrambling and decoding with low processing in- 

30 tensity. 

It will be clear that the scrambling is carried out 
at the transport stream level, i.e. by scrambling at least 
part of the TS packet payloads 9 of selected TS packets 7. The 
TS packet header 8, specifically the transport scrambling con- 
35 trol field 13, provides an effective way of signalling to the 
receiver whether a particular packet has a scrambled payload. 
Thus, the receiver need not examine the entire contents of 
each packet • s payload to selectively descramble the encoded 
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data. Rather, it can perform the de scrambling prior to proc- 
essing the actual payload contents. 

The invention is not limited to the embodiment de- 
scribed herein, but fnay be varied within the scope of the 
5 accompanying claims* For example, the encoded data elements 
may be carried in the payloads of transport stream packets as 
defined by other protocols for wireless transmission- Also, 
scrambling may be carried out at thie PBS level, meaning that 
the payload of a PES packet 16 determined to cariY a NAL 
10 unit 15 of a specific type (e.g. IDR) is included amongst the 
packet payloads to be scrambled. 



